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Abstract 

We study general phase structures of neural- network models that have Z(2) lo- 
cal gauge symmetry. The Z(2) spin variable Si = ±1 on the z-th site describes 
a neuron state as in the Hopfield model, and the Z(2) gauge variable = ±1 
describes a state of the synaptic connection between j-th and i-th neurons. The 
gauge symmetry allows for a self-coupling energy among J^-'s such as JijJjhJki, 
which describes reverberation of signals. Explicitly, we consider the three mod- 
els; (I) annealed model with full and partial connections of J^-, (II) quenched 
model with full connections where is treated as a slow quenched variable, and 
(III) quenched three-dimensional lattice model with the nearest-neighbor con- 
nections. By numerical simulations, we examine their phase structures paying 
attention to the effect of reverberation term, and compare them each other and 
with the annealed 3D lattice model which has been studied beforehand. By not- 
ing the dependence of thermodynamic quantities upon the total number of sites 
and the connectivity among sites, we obtain a coherent interpretation to under- 
stand these results. Among other things, we find that the Higgs phase of the 
annealed model is separated into two stable spin-glass phases in the quenched 
cases (II) and (III). 

Keywords: neural network; lattice gauge theory; phase structure 



1. Introduction 

Although it is just a collection of neurons and other biological cells, the 
human brain exhibits quite various functions such as learning patterns and re- 
calling them. We are still in a way to obtain a physical understanding of these 
functions in a comprehensive manner. As a well-known and convincing step on 
this way, one may refer to the Hopfield model [1] for explanation of associative 
memory. Here, the state of i-th. neuron is described simply by a Z(2) variable as 
Si = 1 (excited), -l(unexcited). This model is a good example of a simple phys- 
ical model that describes essential mechanism of some functions of the human 
brain. 
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Concerning to the learning process, many models have been proposed and 
studiedQ. InRef.jlll, theZ(2) gauge model is introduced as a model of learn- 
ing, where the state of synaptic connections from the j-th neuron to the i-th 
neuron is described by the gauge variable Jij = 1 (excitatory connection) and 
-1 (inhibitory connection). The plasticity of Jij is described by the equation of 
motion which basically decreases the gauge- invariant energy subject to fluctu- 
ations caused by random noises. The reason why the local gauge symmetry is 
implemented there is two fold; 

(i) There is a freedom to assign two physical neuron states (excited and un- 
excited) to a two- valued local variable Si = ±1 (See Ref.[4] for more details). 

(ii) In the real human brain, electric signals are transfered according to the 
rule of electromagnetism which is based on the U(l) local gauge symmetry. 
Because Z(2) is a subgroup of U(l) group, the Z(2) gauge symmetry may be 
viewed as a remnant of this U(l) symmetry. 

A by-product of the gauge symmetry is that the time evolution of au- 
tomatically involves a term suggested by Hebb's law[6], J^(t + At) — J%j{t) ex 

SjSj H~ • • • baK 

In Ref.y we introduced a simple Z(2) gauge model defined on the three- 
dimensional (3D) lattice and studied its various aspects such as the phase 
structure, ability of learning and recalling patterns, etc. We obtained some 
interesting results such as an existence of confinement phase in which neither 
learning and recalling is possible. 

Although these results warrant that the Z(2) gauge neural network is worth 
further studies, the 3D lattice model has some flaws as a model of the human- 
brain functions. For example, (i) its nearest-neighbor connections of the 3D 
lattice model are too scarce compared with those of the human brain, and (ii) 
treating Si and on an equal footing in the time evolution is not realistic 
because, in the human brain, the rate of time variation of synaptic strength 
is much slower than that of neuron state. One certainly needs to incorporate 
ample synaptic connections and different scales in time evolution of variables. 

In this paper we consider various models of Z(2) gauge neural network re- 
specting these two points, and study their properties numerically. Comparison 
of these results with those of the above 3D lattice model [H, Q provides us with 
more understanding of the general properties of the Z(2) gauge network and 
relevance of Z(2) gauge symmetry to modeling the human brain. In particular, 
we consider certain quenched models in which the synaptic variables are treated 
as slow-varying quenched variables, and find that there appear spin-glass (SG) 
states. 

The paper is organized as follows: In Sect. 2 we explains the explicit models 
(I-III) in detail. In Sect. 3-5 we present the results of Monte Carlo (MC) simu- 
lations for the phase structure of each model. In Sect. 6 we present conclusions 
and discussions. In Appendices A-E some technical topics are studied. 
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2. Z(2) Gauge Models 



In this section we introduce the Z(2) gauge models, Model I-III, that we 
shall study. They are classified by the following two points; 

(a) magnitude of connectivity of synaptic connections; full and partial con- 
nections or the nearest-neighbor connections on the 3D lattice, 

(b) nature of synaptic variables; annealed one ( varies in a similar time- 
scale as Si) or quenched one (J^ varies much slower than Si). 

These models are listed in Table 1 together with the 3D annealed lattice 
model which we call Model 0. We note here that Models and III are put on 
the 3D lattice where neurons reside on lattice sites, and therefore the distance 
between a pair of neurons can be defined. In contrast, Models II and III have full 
(or partial) connections and there are no concepts of distance between neurons 
as long as one does not introduce explicitly a metric space in which neurons 
reside. 





model 


connections 


synaptic 
variables 





3D lattice/anneal 


3D lattice 


anneal 


I 


full/anneal 


full and partial 


anneal 


II 


full/quench 


full 


quench 


III 


3D lattice/quench 


3D lattice 


quench 



Table 1. List of Z(2) gauge models classified by connections and treatment of synaptic 
variables: Model studied in Ref.|4j] and Models I-III studied in the present paper. 

2.1. Model 0: Annealed 3D Lattice Model 

Before going to Models I-III, let us review Model and its results [4] briefly. 
The energy Eq of Model is given by[Hj 

Eq — C\ ^ ^ ^ S x -\-jjiJxiiSx C-2 ^ ^ ^ ^ J x\iJ x-\-\i,vJ x-\-v,\iJ xv • 

x fl x fl>V 

S x (= ±1) is the neuron variable (Si) put on the site x of the 3D lattice and 
J x ^(= ±1) is the synaptic variable (Jij) put on the link (x : x + n) connecting 
nearest-neighbor sites, where fi = 1,2,3 is the direction index as well as the 
unit vector in that direction. c\ and C2 are real parameters. The ci-term, the 
Hopfield energy describes the process of signals transferring from the neuron 
at x to the neuron at x + \i (and vice versa), and the C2-term describes the 
process of signals running around the contour (x, x + /i, x + \i + x + v) (and 
the reversed one) as a reverberating circuit 0, • This C2-term also corresponds 
to the magnetic energy in the U(l) gauge theory jsj. 

is invariant under the Z(2) gauge transformation, 

S x S x = V x S X i Jxfi J X y — Vx+^JxiiVx-, Vx — if? (2-2) 

due to V* = 1. 
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We introduce the fictitious temperature T as a parameter to control the 
fluctuations of S x and J xfl . The partition function at T is given by 

Z = ^^exp(- J E ), 

e - n E E-nn e . ^ 

S x S x =±l J x fi J x ^=±l 

where we have included the inverse temperature /3 = 1/T into the coefficients 
c\ and C2 (q is proportional to 0). The average (0(5, J)) of a function 0(S, J) 
w.r.t. Zo is given by 

<0(5,J)> = O(5,J)exp(-^ ). (2.4) 

The phase diagram in the c<i-c\ plane is given in FigJTJ There are three 
phases as listed in Table. 2, where the order parameters of the mean-field theory 
(MFT) and the ability of learning and recalling patterns are also given. The 
order of transition is of first-order for the confinement-Higgs transition, while it 
is of second-order for the confinement- Coulomb transition and for the Coulomb- 
Higgs transition [9]. 



phase 




(s x ) 


ability 


Higgs 






learning and recalling 


Coulomb 







learning 


confinement 








N.A. 



Table2. Phases, order parameters of the mean-field theory [101]. and ability of learn- 
ing and recalling patterns in the 3D Z(2) lattice gauge model, Model of ([2.3)) (See 
Ref.[J). The names for three phases are those used in lattice gauge theory 
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Figure 1: Phase structure of the 3D Z(2) lattice gauge model, Model of (|2.3|) , in the C2- 
c\ plane (taken from Ref.Q). The crosses and filled squares denote first and second-order 
transitions respectively. The real curves are the result of MFT, and the dashed curve is the 
self-dual curve on which a part of phase transition points may locate. 
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2.2. Model I: Annealed Model with full and partial connections 

The annealed model with full and partial connections involves N neurons. 
The state of the neuron at the z-th site (i = l,--- ,N) is described by the 
neuron variable Si(= ±1), and the state of synaptic connection connecting j-th 
neuron and z-th neuron is described by the synaptic variable J^ (= ±1). In this 
paper we consider the case of symmetric coupling, = J^, and only with 
i < j are independent [IH . The total number of independent variables of is 
N\ = = N(N — l)/2. We also have the connection parameter e^, 

J 1 connected, , , 

lJ \ disconnected. ^ ' ' 

The energy E\(e) for a fixed configuration of connections, e = {e^}, is given 

by 

E\(e) — —ci^^CijSiJijSj — ^ tijtjktkiJijJjkJki- (2.6) 

i<j i<j<k 

Each term is depicted in Figj2j It may be viewed as a direct extension of the 
energy (|2.1|) of Model 0. We note that the C2-term for reverberation consists 
of the product of three J's in contrast to the product of four J's in the 3D 
model, Model 0, reflecting the difference of the minimum number of J's to 
construct nontrivial (not a constant) gauge- invariant term. We have introduced 
the factor iV -1 in the coefficient of the C2-term for later convenience. One may 
include other gauge- invariant terms to the energy, such as c^JijJjkJkiJh, but 
the properties of the "minimum" form (|2.6p should be studied first. E\(e) is 
invariant under Z(2) gauge transformation similar to (j2.2|) . 

Si^S^ViSu j ij ^y. j = v i J ij V i , Vi = ±l. (2.7) 
The partition function Z\{e) for a fixed configuration e and the average (0} e 




Figure 2: Each term of the energy E\(e) of (|2.6|) of Model I for the case = ejk = £ki — 1- 
The filled circle denotes S% and the segment denotes Jij . 
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over Z\(e) are given by 

s J 

E - II E E-n E (2-8) 

S i Si=±l J i<j Jij=±l 

The connectivity p(e) for a fixed set of is defined by 

P(e) = -^E e ^- ( 2 - 9 ) 
The average (0(S, J)) p for a fixed value p of connectivity is defined by 

(0(s,J)) P = ^E<W P (o(s,J)> e , 

= Ew E^n E ( 2 - 10 ) 

e e i<jeij=0,l 

Namely, we sum over different "samples" with the same value p of connectivity, 
where each sample has different configurations of e^- . To judge phase boundaries, 
we measure the internal energy U and the specific heat C defined by 

U = <£i) P , C = (Ef) p - (Eft. (2.11) 

We note that, for the case of full connections p = 1, e^- = 1 and so the summation 
over eij is unnecessary. 

2.3. Model II: Quenched model with full connections 

In Model II, the synaptic variables Jij are treated as slowly varying quenched 
variables. Then a suitable way to take average may be to (i) consider a config- 
uration of Jij, which we call a sample, generated by certain probability P(J) 
and take an average over first variables Si, and then (ii) take average over dif- 
ferent samples of Jij. Explicitly, as P(J) we take the Boltzmann factor of the 
reverberation term (c2-term) of energy, and write the average over P(J) by 

(/(j))j^E/( J ) p ( J )- ( 2 - 12 ) 
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Then we have the final average (0(S, J)) of 0(S, J) as 

E\ (S, J) = -c^SiJijSj, Z 1 (J) = J2^p(-E 1 (S,J)), 



E 2 (J) = Yl J iJ J jk J ki, Z 2 = ^exp(-£ 2 (J)) , 



N 



i<j<k 



P(J) = ±exp(-E 2 ), (/(J^E^/fJjPfJ), 
Z2 j 
(0(S,J)) = ((0(S,J))s)j. (2.13) 



Similar treatment has been adopted in the theory of SG[12|, [l3j. However, the 
distribution Psg(J) of Jij G (—00,00) is taken there as a Gaussian form, 

Psg(J) k exp ^-aJ2( J ij " J o) 2 j , (2.14) 

which has no correlations among in strong contrast with P(J) of (|2. 13j) . 
Also we note that Psg(J) of ((2.14)) loses Z(2) gauge symmetry for Jo 7^ 0[14]. 
As the thermodynamic quantities, we consider 

U = (E 1 (S,J)), 

C ee (E 1 (S,J) 2 )-((E 1 (S,J))l) J . (2.15) 
We also measure the following order parameters m and q, 

m - jrT,(s i ) = ±'E i ((s i )s)j, 

i i 

« = ^E« 5 ^- ( 2 - 16 ) 

m and q are the generalization of the order parameters of SG0, [l3[ to the 
present model. Namely, if m = and q 7^ 0, then we call this the SG phase. 
Here one may guess that m is the average of a gauge-variant quantity Si and 
should vanish according to Elitzur's theorem[15|. In fact, we show in Appendix 
A that this theorem holds also for quenched systems, so m = always. We shall 
see that our simulation confirms this point. In contrast, q is gauge- invariant and 
free from Elitzur's theorem, and develops nonvanishing values in some regions. 
One may expect that the similar set of averages 

mj = Tv 7 " X^') = '52(( J ij)s)j, 

1 i<j 
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are able to serve as order parameters for the "gauge-glass" phase. However, 
they give rise to trivial values 

mj = 0, qj = 1, (2.18) 

and don't work as order parameters. 

2.4- Model III: Quenched lattice model 

The quenched lattice model is defined in a similar manner as Model II but 
on the 3D lattice. Its energies Ei(S, J) and E2 (J) are given by 



Ei(S,J) — —c\ Sx+^Jx^Sx, 



X fl=l 



E2(J) — _ C 2 ^ ^ JxisJx+v,fiJx+n,vJxn- (2.19) 



X fI<U 



Each term has the same form as in Eq of Eq. (j2.ip . We first take the average 
over S x as 

Z 1 (J) = ^exp(-ia(S,J)), 

s 

(0(S,J)) s = ^j^Y^O(S,J)e W (-E 1 (S,J)), (2.20) 

where ^2 S and are defined in Eq. (j2.3p . 

Then quenched averages are taken w.r.t. P(J) as in Model II, 

P{J) = 6XP( "/ 2(J)) , Z 2 = ^eM-E 2 (J)), 

(O) = ((0)s)j = J2(°( S > J ))s P ( J )- ( 2 - 21 ) 

J 

As observables we measure U, C, q which are defined by the same expressions 
flUED and (pT6|) as in Model II. 

Before going to MC results of next section, we account here for some details 
of our MC method. We first use Metropolis algorithm (l6| for update of vari- 
ables. For some cases of large hysteresis (such as FigJTK below), we adopt the 
multicanonical method [I?}- For Model I, the typical number of sweeps for single 
run is 5000, and we estimate errors using data of 20 runs. For Model II, typical 
sweep number for a fixed configuration of quenched variable is 5000x20, and 
we repeat it for typically 200 samples (configurations) of J^ . For Model III, we 
use the periodic boundary condition, and the typical number of sweeps is either 
5000x20 over 200 samples or 500 x 20 over 1000 samples. 
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3. Model I: Annealed Model with full and partial connections 

In this section we present the results of MC simulations of Model I, the 
annealed model with full and partial connections. We study the case of p = 1 
in SecOJl and p < 1 in Secj3l2. 

3.1. full connections (p = 1.0,) 

In Figl3]we present the phase diagram for p = 1.0 in the c 2 — c\ plane. There 
is one crossover curve and two curves of phase boundaries: 

(i) < C2 < 1.3 Crossover; 

(ii) 1.3 < C2 < 2.0; First-order transitions; 
(hi) 2.0 < C2; Second-order transitions. 

They are determined by the peak of C and possible discontinuity of U. Before 
going into the details of the analysis of each transition, let us present some an- 
alytic arguments (a-c) related to our MC results. 



(a) The case C2 = can be analyzed exactly by the single-link sum, because 
Jij is factorized in the ci-term. For example, for p = 1, the partition function 
is calculated as 



Z\(c 2 = 0) = ^^^Qexp(ci6'iJij6'j) = ^ ]~[ ^ exp(ciSjJijSj) 

S J i<j S i<j Jij 



53 (2 cosh ci)* 1 =2 N (2coshci) M , 



(3.1) 



where we used cosh(ci Si Sj) = coshci due to Sf = 1. 
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■ 2nd N=256 








Figure 3: Phase structure in the C2-c\ plane of Model I with full connections p = 1. (a) 
TV = 64, (b) Several N. As indicated, there are first-order transitions, second-order ones and 
crossovers. The critical value c\ c of c\ for C2 < 2.0 has almost no TV dependence, whereas c\ c 
for C2 > 2.0 behaves as 0(1/N). The latter c\ c should approach to the critical value of the 
infinite-range Ising model c\ c = 1/N of Appendix C in the limit of C2 — > 00 and large N. It 
gives Log(l/N)=-4.16(N=64), -4.85(N=128), -5.55(N=256), as marked on the vertical axis in 
(b). In (a) the dashed curves are results of MFT of Appendix D. They are almost same as 
MC results for C2 > 1.3 but give first-order transitions instead of crossovers for < C2 < 1.3. 
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Because Z\ has no singularity in ci, there are no phase transitions at C2 = 0. 
This is consistent with Fig j3] where we have a crossover at c 2 < 1.3. In Ap- 
pendix B, we study the case p < 1 where U and C are shown to have a form 
U(p) = P U(p = 0), C(p) = P C(p = 0). 

(b) In the region of large c 2 (explicitly speaking, c 2 > 2.0), fluctuations of J^ 
are small and so the C2-term of E\ becomes almost constant. We note that the 
(fully-connected) C2-term of the energy has the lowest value U = —c 2 nCs/N at 
JijJjkJki — 1 for all the triangle ijk. This is achieved by the trivial configuration 
Jij = 1 and its gauge transformed ones(l8|. 

To estimate the critical value c\ c in this region, one may set Jij = 1. Then 
the behavior of the system at p = 1 is controlled by the ci-term with Jij — 1. 
That is, the system reduces to the so-called infinite-range Ising (IRI) spin model, 
the energy E\y& of which is given by 

Ena = -ci^2SiS j . (3.2) 

i<j 

In Appendix C we analyze the IRI model by the saddle-point method, which 
gives rise to the exact result for N — » oo. We see there that the nontrivial 
phase structure is obtained for small c\ such that c\ oc A^ -1 . In fact, there is 
a second-order phase transition at c\N = 1. Then, if we consider the internal 
energy and the specific heat Ci^ 2 of the Ci 5 2-term of the energy separately 
as 

Ei = Ei + E2 , 

U a = (E a ), C a = {El) - (E a )\ (a = 1, 2), (3.3) 

we expect U u d = 0(N), U 2 ,C 2 = 0(N 2 ) for c 2 > 2.0. That is, the magni- 
tudes of U a ,C a are of different order for a = 1,2 for the choice c\ = 0(N~ 1 ) 
and C2 = O(N ). This consideration is supported by Figj3}}, which shows that 
the exact value of c\ c for c 2 ^ 2.0 is very near to the value of IRI model, i.e., 
cic = 1/N. The discrepancy is attributed to the corrections of 0(N~ 2 ) and 
Ofe" 1 ). 

At first, it may sound strange to have a phase transition for c 2 > 2.0 because 
Ui and U2 are unbalanced there. However, that transition is not due to the 
competition between these two terms, but the competition between the energy 
and entropy of the ci-term itself (with fixed Jij 's) as explained above. Therefore, 
that unbalance does not matter. 

On the contrary, as we shall see, in the region c 2 < 2.0, the critical value 
Cic of Ci is O(N ), which is almost independent of N. Then, both Ui and U 2 is 
of 0(N 2 ) with ci,C2 = O(N ). In summary, we always take c 2 = O(N ), and 
therefore U 2 = 0(N 2 ), whereas we allow c\ to vary from 0(N~ 1 ) to O(iV ), so 
Ui varies from O(N) to 0(N 2 ) accordingly. 

(c) Let us comment on the phase structure obtained by MFT based on a vari- 
ational principle [19], which is summarized in Appendix D. As shown in Figj3^i, 
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Figure 4: (a) U/N 2 and (b) C/N 2 of Model I at c 2 = 0.5 and p = 1.0. There is no systematic 
development of the peak of C, so there are no transitions but a crossover. 

it predicts that the first-order confinement-Higgs transition continues down to 
C2 = instead of the MC results which has an end point C2 — 1.3 at which the 
first-order terminates and becomes crossover. We note here that this MFT does 
not necessarily predict the correct results even in the limit N — >• oo in contrast 
with the Sherrington-Kirkpatrick model [13]. This is due to the C2-term which 
has mutual couplings among J^ . 

Let us see the details of each phase transition(crossover) in Figj3l We con- 
sider the following four cases (i)-(iv) in order. 

(i) Between confinement and Higgs phases(0 < C2 < 1.3) 

In Fig|4]we present C and U between the confinement and Higgs phases at 
C2 = 0.5. The round peak of C has no development as N increases. So we con- 
clude that there is only a crossover between these two phases. This is consistent 
with the above argument (a) for C2 = that there is no phase transition along 
c 2 = 0. 

(ii) Between confinement and Higgs phases(1.3 < C2 < 2.0) 

In Fig|5]we present C/N 2 and U /N 2 for C2 = 1.4. The peak of C is sharp and 
develops rapidly as N increases, and also U exhibit a jump (small hysteresis). 
So we conclude that there is a first-order transition between these two phases 
in this region of C2- 

(iii) Between Higgs and Coulomb phases(2.0 < oi) 

In Figl6]we present U a and C a of Eq. (|3.3p for C2 = 10.0. There is a system- 
atic N dependence of the peak of Ci/iV, indicating a second-order transition at 
ci ~ 1/N. This is consistent with the above result (b) of IRI spin model that 
corresponds to C2 = oo. The critical value c\ c N approaches to 1 as expected. 
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Figure 5: (a) U/N 2 , (b) C/N 2 of Model I vs. c\ at C2 = 1.4 and p = 1.0. There is a hysteresis 
in U, and the peak of C develops rapidly as N increases. So there is a first-order transition 
at a ~ 0.2. 



Uj/N 
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0.015 



0.010 
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Figure 6: (a) U/N 2 , (b) Ui/N, (c) C/A^ 2 and (d) Ci/N of Model I vs. Na at c 2 = 10.0 
and p = 1.0 (Ui and Ci are defined in Eq. (j3.3|n . There is a second-order transition at 
ci ~ 0(1/N). In the limit of C2 — > oo and TV — >■ oo, the peak location of C should approach 
to the value Nc\ c = 1.0 of the IRI model of Appendix C. 
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Figure 7: U/N 2 and C/7V 2 of Model I at a = 0.0 and p = 1.0. (a) U/N 2 by Metropolis 
updates, (b) U/N 2 and (c) C/N 2 by multicanonical method. The hysteresis in U and the 
strongly TV-dependent development of the sharp peak in C exhibit a first-order transition. The 
range of hysteresis in U is reduced significantly by multicanonical method. The dashed line in 
(b) shows U/N 2 = —NC3C2/N 3 with TV = 80 for the completely ordered case JijJjkKki — 1- 

(iv) Between confinement and Coulomb phases 

In Figdwe present U /N 2 and C/N 2 for c\ = 0.0. There is a sharp N depen- 
dence of the peak of C and hysteresis on J7, so there is a first-order transition. 
This is in contrast to Model 0, which exhibits a second-order transition between 
the confinement and Coulomb phases [4j. We note that this difference of the 
order of the transition at c\ = does not come from the difference of the power 
of the C2 interaction, i.e., the quartic one J J J J and the cubic one J J J. In 
fact, the MFT of Appendix D supports this interpretation explicitly, because 
it predicts a first-order transition for both cases (See Ref.[4{ and Appendix D). 
This difference of the transition order should reflect the difference of connectiv- 
ity, that is p = 1.0 in Model I and p = 0(1 /N) in Model III (See discussion of 
Sect. 3. 2 for more details). 

In the Coulomb phase, the configuration of Jij is strongly ordered after the 
transition at C2 ~ 2.0. In fact, FigJTb shows that U/N 2 is near its saturated 
value U /N 2 = —NC3C2/N 3 (shown by the dashed line) which is given by setting 

Jij Jjk Jki — !• 

We also note that the straightforward Metropolis algorithm (FigJTK) gives 
rise to a huge hysteresis in U , while a multicanonical method (FigJ7t>,c) gives 
rise to a moderate hysteresis. The latter is useful to locate a more accurate 
location of the transition point. 
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3.2. partial connections (p < 1 ) 

Let us consider the phase structure for partial connections. In Fig|8] we 
present the phase diagram in the ci-c\ plane for p = 0.9,0.5,0.3 in which we 
plot the location of the peak of C. As in the case of p = 1.0, this peak exhibits 
crossover for the small region (p 2 C2 < 1.3) and first-order transitions for 



1.3 < p 2 C2 < 2.0. The curves for 2.0 < p 2 C2 are of second-order transitions, 



which have the critical value c\ c oc 1/N for general N as explained for p = 1.0. 

In FigJHb we present the critical curves c\ c with various p in the p 2 C2-c\ plane, 
which show that they have almost a scaled universal curve c\ — ci c (p 2 C2). This 
may sound strange because one may expect that the effective couplings scale as 
ci^ij ~^ P c i an d C2€ij€jk€ki —> p 3 C2. However, it is too simple and the reason of 
this scaling can be suggested from the result for the case of C2 = 0.0. The exact 
study in Appendix B gives rise to the location of the peak of C at c\ ~ 1.20, 
which is determined by the equation c\ tanhci = 1 [See Eq. (|B.3|) ] and has no p 
and N dependences, because both C and U are proportional to p there. Thus 
one may expect for the general case of C2 ^ that U ~ Npc\U\ + N 2 p 3 C2U2 = 
p[Nc\Ui + N 2 p 2 C2U2] with u\^U2 = O(N°p ). Then the relevant parameters 
may become c\ and p 2 C2, which are in fact the case as FigjSb shows. 

Let us comment on the confinement- Coulomb transition, which, for p = 1.0, 
is of first-order and takes place at C2 — 2.0. For p < 1.0, it remains of first- 
order and takes place at p 2 C2 — 2.0. We recall that the lattice model, Model 
0, gives rise to a second-order confinement- Coulomb transition. Because the 
connectivity of Model may be estimated as p c± 3N/nC2 — 6/7V, Model 
may be viewed as Model I in a special limit of dilute connectivity p ~ 0. And 
therefore one may expect that the confinement- Coulomb transition of Model I 
becomes of second-order as p becomes sufficiently small, for p < p c {^ 0). It is 
a future problem to estimate the possible critical value p c (The exponent a of 
p c = 0(N a ) may be or -1, or other nontirivial value). 




Figure 8: Phase diagram of Model I with partial connectivities, p = 0.9, 0.5, 0.3 together with 
p = 1 (TV = 64) (a) in the C2-c\ plane and (b) in the p 2 C2-c\ plane. In (b), the curves for 
< p 2 C2 < 1-3 show crossover, 1.3 < p 2 C2 < 2.0 show first-order transitions, and those for 
2-0 < p 2 C2 show second-order transitions. The critical values in the region of 2.0 < p 2 C2 is 
Clc = 0(7V -1 ) for general N. 
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Figure 9: (a) U/N 2 and (b) C/N 2 of Model I at p = 0.3, c 2 = 5.555 for 30 samples. Each curve 
is for each sample and the error bars are errors in thermal(MC) averages. The deviations over 
samples are smaller than MC errors. 



We note that FigJS] is obtained by using a set of data U and C of only one 
sample, because we have checked that the location of C has small deviation 
over different samples. For example, in Figj9]we present U and C along C2 = 
5.555(p 2 C2 = 0.5) for 30 samples with p=0.3. There are 30 curves with each 
curve for each sample. The error bars in Figj9] denote errors associated with 
MC sweeps (thermal average) of each sample. Fig|9] shows that the deviations 
of U, C over samples are smaller than these errors by factor ~ 2. So we judge 
that the result of one sample is reliable for 0.3 < p < 1.0. 
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4. Model II: Quenched model with full connections 

In this section we study the phase structure of Model II. In FigJTU] we first 
present its phase diagram in the ci-c\ plane. Here we recall that the configu- 
rations of synaptic variables Jij are completely determined by P{J) of (|2.13p . 
From the analysis of Sect. 2.1 for c\ = 0.0, P(J) describes a first-order phase 
transition at — 2.0 for p = 1.0. This transition at — 2.0 survives in Model 
II for all ci. 

FigJTU] shows that there are other two phase transition lines, both of which 
is of second order. One is in the region C2 < 2.0 at c\ c ~ 0.15 for N = 64 and 
separates the confinement phase c\ < c\ c and the another phase c\ > c\ c . We 
call this phase c\ > c\ c a SG phase (we call it SGI phase) as we shall see that 
the SG order parameter q is nonvanishing there. Also we shall see that the value 
of cic scales as c\ c ex 1/y/N as N increases. 

The other transition line is in the region C2 > 2.0 at c\ c ~ 0.02 for Af = 64 
and separates the Coulomb phase c\ < c ic and another SG phase for c\ > c ic 
(we call it SG2 phase). The value of c\ c scales as c\ c oc 1/N as N increases, 
which is similar to Model I. 

Let us see each transition in details. 



(i) confinement-SGl transition 

In FigHl]we present U, C, m and q vs. \fNc\ for C2 = 1.5. The N depen- 
dence of the peak of C indicates a second-order transition. The behavior of m 
and q show that the phase of higher c\ is the SG phase. 

In Model I, the exact treatment for C2 = in Appendix B exhibits a crossover 
as ci varies. The reason that Model II exhibits a second-order transition line 
in this region (0 < C2 < C2 C ) instead is traced back to our treatment of as 
quenched variables. In Appendix E we make use of the resemblance of Model 
II at C2 = and the Sherrington-Kirkpatrick model [13| of SG, and present a 
plausible argument that Model II for C2 = has a second-order transition at 
ci ex 1/VN. 




Figure 10: Phase diagram of Model II in the C2-c\ plane for N = 64. There are four phases 
separated by boundaries with 1st and 2nd-order transitions as indicated. The Higgs phase of 
Model I is separated to two SG phases (SGI and SG2). The crossovers of Model I disappear 
and the lst-order transitions continue down to C2 = 0. The critical value of second-order 
transitions behaves as c\ c = 0(1/ y^N) for C2 < 2.0 and c\ c = 0(1/ N) for C2 > 2.0. 
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1 2 3 4 5 N 1/Z ci 



Figure 11: (a) U/N, (b)C/N and (c) q,m of Model II vs. ^Na for c 2 = 1.5. It shows a 
second-order transition into a SGI phase, m vanishes as expected. 

This result c\ c ex 1/y/N for c 2 < 2.0 can be also understood as a compromise 
of the two results; (a) c\ c = 0(N~ 1 ) of annealed Model I for c 2 > 2.0 where 
Jij are almost ordered, and (b) c\ c = 0(N°) of Model I for c 2 < 2.0 where Jij 
are random. In fact, configuration of Jij in each sample of the quenched Model 
II for c 2 < 2.0 is almost fixed, but the spatial average of JijJjkJki is much less 
than its saturated value 1. Therefore the effect of may be smaller than the 
complete order in the case (a) but larger than the complete randomness in the 
case (b). 

(ii) Coulomb-SG2 transition 

In FigJT2l we present U/N, C/N and q vs. Nci for c 2 = 2.5. The N 
dependence of the peak of C indicates a second-order transition at Nc\ c± 1.15. 
The behavior of q shows that the phase of higher c\ is the SG phase. 

FigH2H shows C/N of 200 samples (different configurations of Jij)] each 
curve is for each sample. It shows that the deviations over samples are smaller 
than typical errors in thermal average over different Si. Therefore we judge that 
200 samples are sufficient to obtain the location of specific heat along a fixed c 2 
semiquantitatively. 

(hi) Transition across the c 2 — 2.0 line 

As explained, this first-order transition curve reflects P(J) of (|2.13p as al- 
ready shown in FigJTl for Model I at c\ =0. Explicit calculation of U and C 
across this transition for fixed c\ is time-consuming because one needs multi- 
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canonical method due to large hysteresis of Metropolis updates as FigJTH shows. 
In place of such a calculation, in Fig|l3]we present U/N 2 , C/N 2 of (|2.15p and 
q, which are calculated with Metropolis updates by selecting runs along the 
lower-energy branch of the hysteresis curve in FigJTH. These runs are realized 
by a cold start such as Si = Jij = 1 and the results are reliable qualitatively 
because the transition point C2 C — 1.85 (A 7 " = 64) determined by this method is 
not far from the true value C2 C — 2.04 given in Figj7fc>,c (~ 10% deviation). In 
Fig 03k, h we a l so present U2 and C2 for the C2-term defined by 

7? = - C ± T T T 

J - J 2 — / j J ij J jk*J kii 

i<j<k 

U 2 = -(E 2 ), C 2 = {El) - (E 2 ) 2 , (4.1) 

and calculated by this Metropolis updates. These definitions are equivalent to 
U, C of Model I at c\ — 0, and therefore they should be compared with Figllksc. 
Actually they have no significant differences. 

FiglHf shows that q has a jump Aq ~ 0.4 across the SG1-SG2 phase transi- 
tion, and q ~ 1 in SG2 phase. It shows the difference of two SG phases clearly. 
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Figure 13: Metropolis calculations of U/N 2 , C/N 2 and q of Model II at (a-c) ci = 0.075 for the 
confinement- SG2 transition and at (d-f) c\ = 0.225 for the SG1-SG2 transition. Both of them 
are of first-order, (g) U2/N 2 and (h) C2/N 2 are defined in Eq. (|4.1|) and should be compared 
with Fig(3),c of multicanonical calculations. The dashed line in (g) is U2/N 2 = —C2NC3/N 
for N = 64 corresponding to the saturated value JijJjkJki — 1- 
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5. Model III: Quenched lattice model 

In this section we study the phase structure of Model III. In FigJTHwe present 
the phase diagram in the c^-c\ plane. The overall phase structure is similar 
to that of Model II, but the second-order transition between the confinement 
and the SGI phases of Model II (02 < 2.0) becomes a crossover. This may 
be accounted for by the fact that the connectivity among Si in Model III is 
restricted to the nearest-neighbor neurons and much weaker than in Model II. 
The argument of obtaining the second-order transition for Model II by referring 
to the Sherrington-Kirkpatrick model in Appendix E fails due to the scarce 
connectivity of Model III, which does not validate the saddle-point estimation 
of Ref.[13]. Therefore, it is harder to obtain an ordered phase of Si in Model 
III compared with Model II. 

Furthermore, the critical value c\ c for C2 > 2.0 depends on N weakly, but 
it is almost constant in contrast with 1 /TV-dependence of Model I and Model 
II. This is also due to the scarce connectivity and consistent with the previous 
result for annealed 3D model in which c\ c for > 2.0 is 0(N°) (Note there is 
no extra factor iV _1 in the C2-term in Eq. (j2.ip and Eq. (|2.21)) ). 

Let us see each phase transition and crossover. 

(i) Crossover between the confinement and SGI phases 

In Figjl5] we present U/N, C/N and q vs. c\ for C2 = 0.5. C/N shows 
a crossover between confinement and SGI phases because it has almost no N 
dependence. 

(ii) Coulomb-SG2 transition 

In Fig{16] we present U/N, C/N and q vs. c\ for C2 = 1.0. C/N shows 
a second-order transition between Coulomb and SG2 phases because its peak 
develops systematically as TV increases. 





: x 2nd 
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Figure 14: Phase structure of Model III, the quenched 3D lattice model, in the C2-c\ plane. 
The boundaries are determined by the location of the specific heat C for iV = 12 3 . The 
second-order confmement-SGl transition in Model II becomes crossover. 
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Figure 15: (a) U/N , (b) C/N, (c) q of Model III vs. ci for c 2 = 0.5. There are no sharp 
transitions but a crossover between the confinement and SGI phases at y/Nc\ ~ 0.35 ~ 0.40. 



U/N C/N 




Figure 16: (a) U/N, (b) C/N, and (c) q of Model III vs. a for c 2 = 1.0. There is a 
second-order transition between the Coulomb and SG2 phases at c\ ~ 0.225. 
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(iii) Transition across the line C2 — 0.75. 

Because the system is quenched one, this second-order transition reflects the 
C2-term of the energy. It has been studied in Model at c\ = 0[4|. In this 
case, after the duality transformation, this pure-gauge system becomes equiva- 
lent to the Ising spin model in three-dimensions, which is well known to exhibit 
a second-order transition. In FigJTTl we present U and C at ci=0.1 and 1.0. 
They exhibit a second-order transition as expected. 
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Figure 17: U/N, C/N and g of Model III at (a- c) ci = 0.1 and (d-f) a = 1.0. They show a 
second-order transition reflecting P(J) of (|2.21|) . 



6. Conclusions and Discussions 

In this paper we have studied three versions of the Z(2) gauge neural network, 
Models I, II, and III, and compared them each other and with the annealed 3D 
lattice model (Model 0). The effect of reverberating signals is, in short, to 
enhance the order and stability of synaptic connections J^ . For example, as 
C2 is increased along the line of c\ =0, the confinement phase for C2 < C2 C is 
converted to the Coulomb phase for C2 > C2 C (See Figsl3l fTUl HH]) . 
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Concerning to the phase structure, the obtained phases and the order of 
transitions are summer ized in Table 3. These results are consistent each other; 
one may interpret them in a coherent manner considering how each term of U 
and C, critical values c\ c and C2 C , and the order of transition depend on the 
total number of sites N and their connectivity p as discussed in Sect. 3-5. 
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Table3. Orders of phase transitions for various models. CO implies crossover. The 
upper table is for the annealed models, Models and I, and the lower table is for the 
quenched models, Models II and III, where SGI is the phase at C2 < C2 C and SG2 is 

at C2 > C2c- 



For the annealed model, Model I, the obtained phases are same as three 
phases of Model 0, but the order of confinement- Coulomb transition becomes 
1st order instead of 2nd order. As discussed in Sec.3.1, this reflects the difference 
of connectivity. 

For the quenched models, Models II and III, the Higgs phase of the annealed 
models is better classified as the SG phase. Actually, the quenched transition at 
the critical value C2 = C2 C , which is independent of ci, partitions the Higgs phase 
into two separate SG phases, SGI (c2 < C2 C ) and SG2 {pi > C2 C )- These two 
phases are both characterized by nonvanishing SG order parameter q, but are 
distinguished by disorder (SGI) and order (SG2) of gauge variables Jij as ex- 
plained by using FigIT3f.g. This is another example of the effect of reverberating 
signals. 

There we introduced U2 = (E2) and C2 defined in (|4.1|) . We note that this 
U2 may be viewed as an example of Wilson loop. In the usual lattice gauge 
theory without matter fields, which has only a plaquette interaction JJJJ, the 
confinement phase and the Coulomb phase are distinguished by the behavior of 
the Wilson loop[8| as 

Pi _ ,-r-r . J exp(— aS) confinement phase 
W [GJ = vLl Jx »' ~ \ exp(-a'P) Coulomb phase, 

(6.1) 

where the product is taken along a closed loop C on the lattice, and S is the 
minimum area having its edge C, and P is the perimeter of C. 

To examine the critical properties of the present models, it is necessary to 
study their scaling properties such as critical exponents of their second-order 



23 



transitions by applying finite-size scaling argument to MC results, although such 
a study is beyond the scope of the present paper. Concerning to this point, we 
recall a work by Hashizume and Suzuki [201. They studied the 3D lattice model, 
which is equivalent to the present model [2l|, Model and Model III at c\ = 0, 
by a kind of MFT and correlation identities, and obtained approximately the 
transition temperature, scaling functions, and critical exponents, etc. Such an 
analytical and simple method may give us some hints to calculate approximate 
critical exponents and related quantities for other cases of the models studied 
in the present paper. 

As general subjects for future investigations of the Z(2) gauge neural net- 
work, following points may be listed up as interesting extension of the models 
themselves. 

- In this paper, we restricted ourselves to the region of ci,C2 > 0. We chose 
this region because the ci-term with c\ > may be regarded as a rescaled en- 
ergy of the Hopfield model and the C2-term of reverberating signals corresponds 
to the energy of magnetic field for C2 > 0[8]. Study beyond this region may lead 
us to some new phases and transitions among them[22|. 

- We put the constraint \J%j\ = 1 for the synaptic strength for simplicity. 
Even if one uses other distribution of with same mean and covariance in 
place of \Jij\ = 1, the global phase structure should be unchanged as long as 
one uses the same energy as argued in Ref.[23]. However, modification of the 
energy together with relaxing to < \Ja\ < oo will serve as a model to in- 
vestigate spontaneous distribution of | Jij | [24J . This is an interesting possibility 
because some parts of the human brain has a log- normal distribution of \Jij\ 
which is a key structure to explain some activities of the human brain(25|. 

- One may consider nontirivial structure of connectivity such as a small- 
world network[26j, etc. This is interesting because the actual network structure 
of some parts of the human brain are known to be small- world type. 

- It is of interest to study the asymmetric case with two independent gauge 
variables, Jij and Jji for a pair i < j [11] . This case is expected to describe some 
interesting effects such as spontaneous oscillations in time-development of the 
system. 

Appendix A. Elitzur's theorem for quenched systems 

In this appendix we derive Elitzur's theorem for quenched systems. Let us 
start by a brief derivation of the theorem for the annealed model, Model I. The 
average (0(S, J)) of (|2.8j) is written in the form, 

(0(S,J)) = ^^0(S,J)ex P (-£(S,J)). (A.l) 

s J 
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Here it is sufficient to consider the average over each sample with definite e^, 
because the final average is just the sum ([2.10)) of such average. By regarding 
the gauge transformation (|2.7p as a change of variables Si — >• 5^, Jij — >• J^-, 
0(5, J) of (jA.ip is rewritten as 

(0(5, J)) = ^^0(5',J')exp(A(5',J')) 

= E E J/ ) exp(A(S, J)) = (0(5', J% (A.2) 



5 J 

where we used 

a(s',j') = a(s,j), E = E- E = E- ( A - 3 ) 

5' 5, J'. Jij 

Let us restrict 0(5, J) to those satisfying 

0(S',J') = G(V)0(S,J). (A.4) 



Then (|A.2|) claims that 

(0(5,J))=G(y)(0(5,J)). (A.5) 

If 0(5, J) is a gauge- invariant quantity, then G(V) = 1, and (jA.5|) poses no 
restrictions to (0(5, J)). If 0(5, J) is a gauge-variant quantity, then G(V) 7^ 1 
and the following theorem is derived, 

If 0(5, J) is gauge variant, then (0(5, J)) = 0. (A.6) 

For a general 0(5, J) that does not satisfy (|A.4|h it may be expressed as a 



sum 



0(S,J) = J2o e (S,J), 



e 

1> T>\ 



O e (S',J') = Ge(V)O e (S,J). (A.7) 

Then it is straightforward to derive the theorem (jA.6|) . 

Let us consider the quenched model, Model II for example. The average is 
given by flUHJ), 

ms, j)) = EEo(Sj f M - E ;^ J)) p(j), 

j s Al[J) 

Z 1 (J) = ^exp(-^(5,J)). (A.8) 

s 

We repeat the same change of variables (|2.7p and note the gauge invar iance, 

E 1 (S', J') = E^S, J), Z^J') = Z 1 (J), P(J') = P(J), (A.9) 

to get 

(0(S,J)) = (0(S',J')). (A.10) 

Then we follow the same steps as for the annealed model to arrive at the theorem 
CO}. 
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Appendix B. Exact solution for C2 = 



In this Appendix, we study the exact solution of Model I for C2 = 0. The 
partition function for a sample with a definite is calculated as 



i<j 



Z C2 =o(e) = ^^exp(-£ C2=0 (e)) =^^exp(c 1 ^2e ij Ji j S i S j ) 

S J S J 

= Yl expiaeijJijSiSj) 

s i<j J i:j =±l 

= ^2 II [exp(ci€ijSiSj) + ex.p(-ci6ijSiSj 

s i<j 



^[][2^, 1 coshc 1 + 2^, ] 



S i<j 



2 N ]J [25 €ijtl cosh ci +2^,, ]. 



(B.l) 



Then the partition function Z C2 =o averaged over samples is given by 

Z C2 =o 



TV 



1 X > at N(N-l) N(N-1),~ \ 

^5 p(e))J ,Z C2=0 (e) = 2 W (2cosh Cl )^— p 2^— ^-f), (B.2) 



where we used the fact that the number of links of e^- = 1(0) in a sample is 
N&2P [atC^I — p)]. Then the internal energy U and the specific heat C are 
calculated as 

U 

c 



(E) p = -ci— lnZ C2=0 



TV (TV — 1) 



pc\ tanh ci , 



dU 



d (U\ _ TV (TV - 1) pc? 



cosh ci 



(B.3) 



We note that U and C are proportional to p as it should be. We have checked 
that the MC results agree with these results as shown in FigJTHJ 
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Figure 18: The MC results of (a) U and (b)C of Model I at c 2 = for p = 1.0 and N = 128. 
They agree with the analytic expressions of (|B.3|) . 
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Appendix C. Infinite-Range Ising spin model 

Let us study the IRI spin model (|3.2p . The partition function is rewritten 



as 



Zim = J2exp(c 1 J2SiS j ) = J2 e MjJ2 S ^-i N ) 

S i<j S i,j 

= exp(-^7V)(2^ Cl )-^ / d X exp(-— X 2 +xE^) 

C i f°° ( 1 

= exp(-yAT)(27rci)-5 / eZ X exp I -— X 2 + iVln(2coshx) 
= exp(-iVF IR + O(iV )) ) 
FlRI = ^^o-M2cosh X o), (C.l) 

where we assumed that c\ = 0(N~ 1 ) and used the saddle-point evaluation for 
large N. xo is the solution of the saddle-point equation, 

X 1 tanhx = 0. (C.2) 



Nci 

Xo exhibits a second-order transition at c\ c — 1/N 



. - 0, Nd < 1, , q\ 

^0, iV Cl >l. ^ 



Appendix D. Mean field theory for Model I with p = 1.0 

In this Appendix we study MFT of Model I with p = 1.0 based on the Feyn- 
man's met hod 119)]. It is formulated as a variational principle for the Helmholtz 
free energy F by using the variational (trial) energy Eq as follows; 



Z = ^exp(-^i3)=exp(-/?F) ) 

S,J 

Z = ^exp(-/3£ ) =exp(-/3F ), 

S,J 

(O) = Z^Y,OeM~PE ), 



S,J 

F < F v =Fo + (E-E )o. (D.l) 

We adjust the variational parameters contained in Eq optimally so that F v is 
minimized. 
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For Eq we use 



E = -Wj2 J iJ- h J2 Si > 



(D.2) 



i<j i 

where W and h are real variational parameters. Then we have 



fv = 



N N 
Ni 



ln(2 cosh f3W) - ln(2 cosh f3h) 



c 1 '-£m 2 M-e 2 N 



M 3 + ^WM + hm, 



(Si) = tanh/i, M = (Jy) = tanh W. 



(D.3) 



The minimization of f v yields the three phases characterized as follows; 

(D.4) 



phase 


M 


m 


Higgs 




^0 


Coulomb 


^0 





Confinement 









The phase boundaries are shown in FigJT9j The discontinuity of order pa- 
rameters of each transitions are as follows; 



phase boundary 


order 


AM 


Am 


Confinement- Coulomb 


1st 







Higgs- Coulomb 


2nd 








Higgs- Confinement 


1st 


7^0 





(D.5) 



For the Higgs-Coulomb transition, the critical value of c\ is estimated as 

Nil /T~\ \ 

Clc = mM^N' (D - 6) 

for large TV and large C2 at which M ~1. 
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Figure 19: MFT result for the phase structure of Model I with p = 1.0 in the ci-c\ plane 
(N = 64). There is a first-order transition curve starting at c\ c — 0.334(c2 = 0) and ending 
at c\ c = 0(c2 — 2.13), and a second-order one along c\ c — 1/N(c2 > 2.0) . 
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Appendix E. Comparison of Model II at C2 = and the Sherrington- 
Kirkpatrick model 



In this Appendix we study a possible phase transition of Model II at C2 = 
by using the known result of Sherrington-Kirkpatrick (SK) model[13]. 
The energy of the SK model is given by 

£sk = -^JijSiSj, Si = ±1, Jij e (-00,00). (E.l) 

i<j 

The quenched variable Jij is a real number (we use the same symbol with our 
Jij = ±1), and distributes by the Gaussian weight, 

™ ■ n£-(-o#). <-» 

Then the replica-symmetric solution for large N (which is accepted as correct 
ones for small Jo) gives rise to a phase-diagram in the Jo/ J — (1/ J) plane in 
which there is a horizontal second-order phase transition line along 1/ J = 1 for 
Jo/J< 1 separating the SG phase m = 0, q ^ (1/ J < 1) and the paramagnetic 
phase m = 0, q = (1/ J > 1). From the point 1/J = 1, Jo/ J = 1, two transition 
curves spring out to border the ferromagnetic phase m 2 in the larger 

Jo/ J region (Note that Z(2) gauge symmetry is violated for Jo ^ 0). 

Let us turn to Model II at C2 = and deform it by replacing J^ = ±1 to 
a real variable with an optimally determined distribution of the form of P$k of 
(|E.2|) . We choose P$k to generate the same mean value and variance as P( J) of 
(|2.13p . i.e., (Jij)p SK = 0, (Jfj)p 3K = 1. This treatment of Z(2) variable by real 
Gaussian variable may preserve universal critical properties of the system [23]. 
This determines the optimal P$k as 

TV 1 / 4 / 7 2 \ 

^> = n vet* (--?)■ ("> 

To adjust Esk to £"i of (|2.13p . we replace J^ of the SK model by c\ Jij. Then 
Psk(J) of (|E.2[) becomes the same as Eq. (|E.3[) by choosing Jo = and 

C ^ = 1. (E.4) 



J 2 /7V 

Then, the established transition point of SK model for Jo = 0, J = 1 predicts 
the location of second-order transition of Model II at C2 = as 

* (E.5) 



This gives an estimate c\ c = 0.125 for N = 64, which should be compared with 
the MC result of FigJlOj c\ c ^ 0.15. Inclusion of the C2-term makes summation 
over Jij variables difficult analytically. 
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